SOURCE BASED SCHEME TO ESTABLISH COMMUNICATION PATHS IN AN 

OPTICAL NETWORK 



CROSS-REFERENCE TO RELATED APPLICATIONS 

[00011 This is a continuation of Application No. 10/455,933, filed June 6, 2003. 

BACKGROUND 
Field 

[0002] Embodiments of the invention relate to the field of networking; and more 
specifically, to optical networks. 

Background 

[0003] Generalized Multiprotocol Label Switching (GMPLS) [RFC3471] extends the 
Multiprotocol Label Switching (MPLS) architecture [RFC3031] to encompass time- 
division (e.g.. Synchronous Optical Network and Synchronous Digital Hierarchy, 
SONET/SDH), wavelength (optical lambdas) and spatial switching (e.g., incoming port 
or fiber to outgoing port or fiber). 

[0004] GMPLS extends MPLS to include network devices whose forwarding plane 
recognizes neither packet, nor cell boundaries, and therefore, can't forward data based 
on the information carried in either packet or cell headers. Specifically, such network 
devices include devices where the forwarding decision is based on time slots (TDM), 
wavelengths (lambda), or physical (fiber) ports. GMPLS supports uni-directional label 
switched paths (LSPs) and bi-directional LSPs (For bi-directional LSPs, the term 
"initiator" is used to refer to a node that starts the establishment of an LSP and the term 
"terminator" is used to refer to the node that is the target of the LSP; Note that for bi- 
directional LSPs, there is only one "initiator" and one "terminator") and a special case 
of Lambda switching, called Waveband switching (A waveband represents a set of 
contiguous wavelengths which can be switched together to a new waveband; The 
Waveband Label is defined to support this special case; Waveband switching naturally 
introduces another level of label hierarchy; As far as the MPLS protocols are concerned 
there is little difference between a waveband label and a wavelength label.). 
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[0005] To deal with the widening scope of MPLS into the optical and time domain, 
there are several new forms of "label." These new forms of label are collectively 
referred to as a "generalized label." A generalized label contains enough information to 
allow the receiving node to program its cross connect, regardless of the type of this 
cross connect, such that the ingress segments of the path are properly joined. The 
Generalized Label extends the traditional label by allowing the representation of not 
only labels which travel in-band with associated data packets, but also labels which 
identify time-slots, wavelengths, or space division multiplexed positions. For example, 
the Generalized Label may carry a label that represents (a) a single fiber in a bundle, 
(b) a single waveband within fiber, (c) a single wavelength within a waveband (or 
fiber), or (d) a set of time-slots within a wavelength (or fiber). It may also carry a label 
that represents a generic MPLS label, a Frame Relay label, or an ATM label 
(VCWPI). 

[0006] Thus, GMPLS forms label switched paths (LSPs) through the network. These 
paths may be connection oriented or connectionless. For instance, the Resource 
Reservation Protocol (RSVP) is often used to deploy connection oriented LSPs, 
whereas a label management protocol (LMP), such as the label distribution protocol 
(LDP), is often used to provision connectionless LSPs. 

Optical Networks 

[0007] An optical network is a collection of optical network devices interconnected 
by links made up of optical fibers. Thus, an optical network is a network in which the 
physical layer technology is fiber-optic cable. Cable trunks are interconnected with 
optical cross-connects (OXCs), and signals are added and dropped at optical add/drop 
multiplexers (OADMs). The optical network devices that allow traffic to enter and/or 
exit the optical network are referred to as access nodes; in contrast, any optical network 
devices that do not are referred to as pass-thru nodes (an optical network need not have 
any pass-thm nodes). Each optical link interconnects two optical network devices and 
typically includes an optical fiber to carry traffic in both directions. There may be 
multiple optical links between two optical network devices. 

[0008] A given fiber can carry multiple commxmication channels simultaneously 
through a technique called wavelength division multiplexing (WDM), which is a form 
of frequency division multiplexing (FDM). When implementing WDM, each of 
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multiple carrier wavelengths (or, equivalently, frequencies or colors) is used to provide 
a communication channel. Thus, a single fiber looks like multiple virtual fibers, with 
each virtual fiber carrying a different data stream. Each of these data streams may be a 
single data stream, or may be a time division multiplex (TDM) data stream. Each of 
the wavelengths used for these channels is often referred to as a lamda. 

[0009] A lightpath is a one-way path in an optical network for which the lamda does 
not change. For a given lightpath, the optical nodes at which its path begins and ends 
are respectively called the source node and the destination node; the nodes (if any) on 
the lightpath in-between the source and destination nodes are called intermediate nodes. 
An optical circuit is a bi-directional, end to end (between the access nodes providing 
the ingress to and egress from the optical network for the traffic carried by that optical 
circuit) path through the optical network. Each of the two directions of an optical 
circuit is made up of one or more lightpaths. Specifically, when a given direction of the 
end to end path of an optical circuit will use a single wavelength, then a single end to 
end lightpath is provisioned for that direction (the source and destination nodes of that 
lightpath are access nodes of the optical network and are the same as the ends nodes of 
the optical circuit). However, in the case where a single wavelength for a given 
direction will not be used, wavelength conversion is necessary and two or more 
lightpaths are provisioned for that direction of the end to end path of the optical circuit. 
Thus, a lightpath comprises a lamda and a path (the set of optical nodes through which 
traffic is carried with that lambda). 

[0010] Put another way, when using GMPLS on an optical network, the optical 
network can be thought of as circuit switched, where LSPs are the circuits. Each of 
these LSPs (uni-directional or bi-directional) forms an end to end path where the 
generalized label(s) are the wavelength(s) of the lightpath(s) used. When wavelength 
conversion is not used for a given bi-directional LSP, there will be a single end to end 
lightpath in each direction (and thus, a single wavelength; and thus, a single generalized 
label). 

[001 1] An optical network device can be thought of comprising 2 planes: a data 
plane and a control plane. The data plane includes those components through which 
the light travels (e.g., the switch fabric or optical crossconnect; the input and output 
ports; amplifiers; buffers; wavelength splitters or optical line terminals; adjustable 
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amplifiers; etc.), add/drop components (e.g., transponder banks or optical add/drop 
multiplexers, etc.), and components that monitor the light. The control plane includes 
those components that control the components of the data plane. For instance, the 
control plane is often made up software executing on a set of one or more 
microprocessors inside the optical network device which control the components of the 
data plane. To provide a specific example, the software executing on the 
microprocessor(s) may determine that a change in the switch fabric is necessary, and 
then instruct the data plane to cause that switch to occur. It should also be noted that 
the control plane of an optical network device is in communication with a centralized 
network management server and/or the control planes of one or more other network 
devices. 

[0012] A number of different network topologies have been developed for optical 
network devices, including ring and meshed based topologies. Similarly, a number of 
different control planes and data planes have been developed for optical network 
devices. For instance, wavelength division multiplexing (WDM) necessitated an 
alteration of the data plane and the control plane. As another example, various different 
techniques have been used for implementing the switch fabric, including optical cross 
connects such as MEMS, acousto optics, thermo optics, holographic, and optical 
phased array. 

[0013] Operating an optical network typically requires: A) building and maintaining 
network databases; and B) establishing lightpaths. For example, the network databases 
can include: 1) link state databases that track information (e.g., the link(s), lamda(s), 
lamda bandwidths, etc.) regarding adjacent optical nodes (e.g., using a link 
management protocol (LMP)); and 2) topology databases that track information (e.g., 
nodes, links, lamdas, etc.) for the physical connectivity of the nodes in a domain and/or 
the entire network (e.g., using OSPF-TE). In order to establish an LSP, the following 
operations are typically performed offline: 1) determining the shortest path(s) between 
source and destination using a shortest path first algorithm based on the network 
database(s); 2) determining the wavelength(s) available on these shortest path(s) based 
on the network datab2ise(s); 3) allocate a wavelength firom the available wavelengths on 
the shortest path (often referred to as signaling the path; effectively telling the involved 
optical network devices how to configure their switch fabrics; e.g., using RSVP or CR- 
LDP based signaling with GMPLS). Steps 1 and 2 can be reversed. 

Attorney Docket No. 6518P002C2 4 



[0014] There are generally three approaches to operating an optical network: 1) 
centralized static provisioning; 2) source based static provisioning; and 3) hybrid static 
provisioning. In centralized static provisioning, a separate centralized network 
management server maintains a network topology database and commimicates with 
each of the optical network devices of a network. In response to some predefined 
demands for an optical circuit, the network management server finds the shortest 
path(s) and selects a wavelength(s) on one. The network management server then 
causes the allocation of the wavelength(s) and the configuring of the switch fabrics. 

[0015] In source based static provisioning, each of the access nodes of the network 
performs the work of building/maintaining a network topology database. In response to 
some predefined demands for an optical circuit received by an access node, that node: 
1) buffers the traffic as necessary; 2) finds the shortest path(s) and selects a 
wavelength(s) on one; and 3) causes the allocation of the wavelength and the 
configuring of the switch fabrics. 

[0016] In hybrid static provisioning, each of the nodes of the network use OSPF-TE 
to build network topology databases, and from there a network topology database is 
built and maintained in a centralized network management server. The network 
management server initiates a form of source based provisioning. This allows a 
network administrator to maintain control over provisioning of each lightpath 
provisioned. 

[0017] One problem with existing optical networks is the network topology databases 
used and the manner in which they are built and maintained. Specifically, these 
monolithic physical topology databases (e.g., built with OSPF-TE) are very large 
because they must store all of the data to give a physical view of the network (not only 
connectivity at the link level, but connectivity at the lamda level because there are 
multiple lamdas per link and because different lamdas on a given link may provide 
different bandwidths; etc.). These large network databases are relatively time 
consuming to parse and require a relatively long time and a relatively large amount of 
node intercommunication to propagate changes. In addition, such network topology 
databases would become even larger if QoS type information needed to be recorded. 

[0018] Another problem with existing optical network devices is there static, off-line 
nature of operation (e.g., using centralized static provisioning, source based static 
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provisioning, hybrid static provisioning, etc.). More particularly, based upon a 
determination of the projected needs of the end node to end node connection through 
the optical network and the then existing state of the optical network (basically, a 
snapshot of the network parameters), an optical circuit is provisioned through the 
optical network over which the traffic is to travel. This optical circuit will be static in 
the sense that it will not be altered on the fly based upon current bandwidth 
requirements (demand changes), current status of the network, etc. Instead, this optical 
circuit will only be modified when it is re-provisioned (e.g., at the request of the 
customer to upgrade to a larger or smaller amount of bandwidth) and/or some form of 
protection switch based on a redundancy scheme. 

[0019] Therefore, a given optical circuit is established at the maximum bandwidth 
believed to be required at any given point in time, and this maximum bandwidth is 
provisioned for that purpose. That is to say, a given customer is provisioned a fixed 
amount of bandwidth for all classes of traffic, whether that customer at any given point 
in time is using some, all or none of that bandwidth. Due to variations in the bandwidth 
requirements and/or the status of the network, bandwidth will go unused. 

[0020] Thus, the optical layer is operated to provide point-to-point links, with no 
intelligence and no real time decision-making capabilities. In addition, the need for 
demands to be known in advance imposes difficulties for service creation and service 
provisioning. This results in an inefficient utilization of resources at the optical layer. 

[0021] Furthermore, while there has been work to provide quality of service (QoS) at 
the IP layer and/or using MPLS, both of these protocols are carried over SONET; 
where SONET does not distinguish the types of traffic (does not provide QoS). Thus, 
typical optical control planes do no provide the ability to separate traffic into different 
classes based on service level requirements (i.e., they do not incorporate service level 
requirements of different types of traffic in lightpath calculations). 

[0022] In addition, redundancy is maintained in typical optical networks using either: 
1) 1+1 protected lightpaths; 2) 1:1 protected lightpaths; or 3) mesh restored hghtpaths. 
A 1+1 protected lightpath firom node A to node B is a pair of node diverse paths in the 
network where one of the paths is a working path, and the other is a protection path. 
The working path and the protection path are established at the same time; when a 
failure occurs over the working path, traffic is switched to the protection path, A mesh 
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restored lightpath from node A to node B is a pair of shared resource group disjoint 
paths in the network, where one of the routes is a working path and the other is a 
backup path. The capacity dedicated on the backup path can be shared with backup 
paths of other mesh-restored lightpaths. Existing optical networks use one or the other 
of these redundancy schemes irrespective of the criticality of the data. 

BRIEF SUMMARY 

[0023] A source based scheme to establish communication paths in an optical 
network is described. According to one embodiment of the invention, a number of 
wavelength division multiplexing access nodes of an optical network employ a source 
based scheme to establish communication paths. Each of these access nodes stores a 
set of one or more network topology databases based on a set of one or more 
connectivity constraints. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0024] The invention may best be understood by referring to the following 
description and accompanying drawings that are used to illustrate embodiments of the 
invention. In the drawings: 

[0025] Figure 1 is a block diagram illustrating an exemplary optical network 
according to one embodiment of the invention. 

[0026] Figure 2 is a block diagram illustrating exemplary QoS based logical network 
views of the exemplary optical network of Figure 1 according to certain embodiments 
of the invention. 

[0027] Figure 3 A illustrates service level A's conversion free service level topology 
for Nl of the optical network in Figure 2 according to certain embodiments of the 
invention. 

[0028] Figure 3B illustrates service level B's conversion free service level topology 
for Nl of the optical network in Figure 2 according to certain embodiments of the 
invention. 

[0029] Figure 3C illustrates service level C's conversion free service level topology 
for Nl of the optical network in Figure 2 according to certain embodiments of the 
invention. 
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[0030] Figure 4 is a block diagram illustrating a hierarchy of terms according to 
certain embodiments of the invention. 

[00311 Figure 5 is a flow diagram for building and maintaining network topology 
databases with a set of connectivity constraints according to certain embodiments of the 

invention. 

[0032] Figure 6 is a flow diagram illustrating the provisioning of lightpaths according 
to certain embodiments of the invention. 

[0033] Figure 7 is a block diagram illustrating an exemplary access node according to 
certain embodiments of the invention. 

[0034] Figure 8 is an exemplary data flow diagram of a distributed search based 
technique's formation of service level A's service level topology for Nl of the optical 
network in Figure 2 according certain embodiments of the invention. 

[0035] Figure 9 is a flow diagram performed by each access node when joining an 
optical network according to embodiments of the invention. 

[0036] Figure 10 is a flow diagram illustrating a service level topology build-up for a 
single service level according to embodiments of the invention. 

[0037] Figure 1 1 is a flow diagram illustrating operations performed by nodes 
responsive to a connectivity request message received over a link according to certain 
embodiments of the invention. 

[0038] Figure 12 is the flow diagram illustrating operations performed by an access 
node to allocate a path according to certain embodiments of the invention. 

[0039] Figure 13 is a flow diagram illustrating operations performed by an access 
node responsive to an update routing database message according to certain 
embodiments of the invention. 

[0040] Figure 14 is a flow diagram illustrating operations performed by an access 
node responsive to an update allocate channel message according to certain 
embodiments of the invention. 

[0041] Figure 15 is a flow diagram illustrating operations performed by the source 
node of a path responsive to that path being deallocated according to certain 
embodiments of the invention. 

Attorney Docket No. 6518P002C2 8 



[0042] Figure 16 is a flow diagram illustrating operations performed by access nodes 
responsive to an update deallocate channel message according to certain embodiments 
of the invention. 

[0043] Figure 1 7 is a flow diagram illustrating the operations performed by the 
access nodes connected by the link on which the channel is added/removed according 
to certain embodiments of the invention. 

[0044] Figure 18 is a flow diagram illustrating the operations performed by an access 
node responsive to receiving an update add/remove channel message according to 
certain embodiments of the invention, 

[0045] Figure 19 is a flow diagram illustrating the operations performed by the 
access nodes connected by the removed link according to certain embodiments of the 
invention. 

[0046] Figure 20 is a flow diagram illustrating the operations performed by an access 
node responsive to receiving a link removal message according to certain embodiments 
of the invention. 

[0047] Figure 21 is a flow diagram illustrating the operations performed by the 
access nodes connected by the added link according to certain embodiments of the 
invention. 

[0048] Figure 22 is a flow diagram illustrating the operations performed by an access 
node responsive to receiving a link addition message according to certain embodiments 
of the invention. 

[0049] Figure 23 is a flow diagram illustrating the operations performed by the 
access node(s) adjacent a removed node according to certain embodiments of the 
invention. 

[0050] Figure 24 is a flow diagram illustrating the operations performed by an access 
node responsive to receiving a node removal message according to certain 
embodiments of the invention. 

[0051] Figure 25 is a flow diagram illustrating the operations performed by an access 
node responsive to receiving a node addition message according to certain 
embodiments of the invention. 
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DETAILED DESCRIPTION 

[0052] In the following description, numerous specific details are set forth (e.g., such 
as logic resource partitioning/sharing/duplication implementations, types and 
interrelationships of system components, and logic partitioning/integration choices). 
However, it is understood that embodiments of the invention may be practiced without 
these specific details. In other instances, well-known circuits, software instruction 
sequences, structures and techniques have not been shown in detail in order not to 
obsciu'e the understanding of this description. 

[0053] References in the specification to "one embodiment", "an embodiment", "an 
example embodiment", etc., indicate that the embodiment described may include a 
particular feature, structure, or characteristic, but every embodiment may not 
necessarily include the particular feature, structure, or characteristic. Moreover, such 
phrases are not necessarily referring to the same embodiment. Further, when a 
particular feature, stmcture, or characteristic is described in connection with an 
embodiment, it is submitted that it is within the knowledge of one skilled in the art to 
effect such feature, structure, or characteristic in connection with other embodiments 
whether or not explicitly described. 

[0054] In the following description and claims, the terms "coupled" and "connected," 
along with their derivatives, may be used. It should be understood that these terms are 
not intended as synonyms for each other. Rather, in particular embodiments, 
"connected" may be used to indicate that two or more elements are in direct physical or 
electrical contact with each other. "Coupled" may mean that two or more elements are 
in direct physical or electrical contact. However, "coupled" may also mean that two or 
more elements are not in direct contact with each other, but yet still co-operate or 
interact with each other. 

Overview 

[0055] According to embodiments of the invention, a set of one or more connectivity 

constraints is imposed on the building/maintaining of network topology databases. As 

a result of the set of connectivity constraints, such network topology databases are 

smaller in comparison to network topology databases that represent all physical 

connectivity in the network. According to one aspect of the invention, the set of one or 

more connectivity constraints includes one or more QoS based criteria; thus, effectively 
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dividing the optical network into QoS based logical network views that may be used to 
provision different wavelengths for different classes of traffic based on differing QoS 
requirements. According to another aspect of the invention, the set of one or more 
connectivity constraints includes a conversion firee constraint; this allows for 
establishing conversion fi-ee optical circuits. According to another aspect of the 
invention, a distributed search based technique is used for building and maintaining 
network topology databases based on a set of connectivity constraints. According to 
another aspect of the invention, an optical network uses a source based scheme in 
which network topology databases, based on a set of connectivity constraints, are kept 
in access nodes. The reduced network topology database size (as compared to a 
physical network topology database) and distributed nature of this source based scheme 
allows for the provisioning of optical circuits in real-time (or on the fly; that is, the 
demands do not need to know ahead of time). 

[0056] Since each of the above aspects is independent, different embodiments may 
implement different ones and/or combinations of the above aspects of the invention. 
For example, certain embodiments of the invention include in the set of coimectivity 
constraints both QoS criteria and conversion free constraints. The network topology 
databases based on this set of connectivity constraints: 1) have reduced size over full 
physical connectivity network topology databases; 2) allow different traffic to be given 
different wavelengths based on QoS for different classes of traffic; and 3) allow for 
establishing conversion free optical circuits. While certain of these embodiments 
implement source based schemes and build/maintain the network topology databases 
using a distributed search based technique, others of these embodiments may use a 
different scheme and/or a different database building/maintaining technique, 

Exemplarv QoS Embodiments 

[0057] Different embodiments of the invention may support different QoS criteria. 
For example, the QoS critera may include bandwidth, bit error rate, optical signal to 
noise ratio, peak noise level, re-routing priority, etc. In other words, the QoS criteria 
may include any criteria that allows different wavelengths to be distinguished from 
each other based on quality of service. For a given wavelength on a given link, the 
values for the QoS criteria (the wavelength parameters) may be determined based on 
the configuration (e.g., the type of laser used) and/or by monitoring the light. 
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[0058] The QoS criteria is used to classify wavelengths on links into one of the set of 
supported service levels. In particular, for each of the QoS criteria, there is a service 
level parameter provided for each service level. The wavelength parameters of a given 
wavelength on a given link are compared against the service level parameters to 
classify that wavelength into one of the service levels. 

Exemplarv Network 

[0059] In certain optical networks, different wavelengths in at least certain nodes 
have different wavelength parameters. For instance, a given optical network device 
may have different groups of wavelengths implemented to operate at different 
bandwidths (e.g., group A at OS-X, group B at OS-Y, and group C at OS-Z) and 
service level parameters that distinguish based on bandwidth. As a result, the optical 
network not only has a given interconnectivity at the physical link level (a physical 
topology), but also has a given interconnectivity for each service level (for each service 
level, a service level topology for the network and for each node), and a given 
interconnectivity for each conversion free service level (for each service level, a 
conversion free service level topology for each node). 

[0060] Figure 1 is a block diagram illustrating an exemplary optical network 
according to one embodiment of the invention. The optical network of Figure 1 
includes 5 access nodes labeled Nl, N2, N3, N4, and N5. The ability to implement 
multiple lamdas on a single link is represented in simplified form by numbering the 
lamdas; lamdas having the same number are the same wavelength. Figure 1 shows the 
numbered lamdas available on each optical link of the exemplary optical network. The 
term "available" when used in conjunction with a lamda number indicates that the node 
is capable of producing that wavelength; the terms allocated and imallocated are used to 
identify whether or not that available wavelength is currently provisioned. To describe 
the physical connectivity illustrated in Figure 1, the format of node number: node 
number is used to indicate there is an optical link between those nodes; and node 
nimiber: node number equals lamda number(s) indicates the wavelengths available on 
that link. Using this format. Figure 1 shows: N2:N2 = lamda 1, 2, 3, 4; N2:N4 = lamda 
1, 3, 5; N4:N5: = lamda 1, 2, 3, 4; N1:N3 = lamda 1, 2, 4; andN3:N4 = lamda 1, 2, 4. 

[0061] It should be understood that the topology in Figure 1 is exemplary, and that 

the invention can be used with any number of different topologies. In addition, while 
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Figure 1 illustrates different wavelengths being available on different optical links, it is 
understood that the same wavelengths may be available on all of the optical links. 
Furthermore, while specific wavelengths are identified as being available in Figure 1, 
optical network devices may be implemented with lasers to allow them to generate a 
variety of different wavelengths and the invention is equally applicable to optical 
networks containing one or more such optical network devices. However, for purposes 
of illustration, embodiments of the invention will be described with reference to the 
wavelengths illustrated in Figure 1 . While the exemplary optical network in Figure 1 is 
made up of access nodes, embodiments of the invention are equally applicable to 
optical networks that include pass through nodes. 

[0062] Figure 2 is a block diagram illustrating exemplary QoS based logical network 
views of the exemplary optical network of Figure 1 according to certain embodiments 
of the invention. In the example of Figure 2, the set of supported service levels 
includes service levels A, B, and C. The wavelength parameters of each wavelength on 
each link have been compared against the service level parameters to classify each 
wavelength on each link into one of the service levels A, B, and C. To refer to a given 
service level, an S is placed in fi"ont of the service level label (SA, SB, SC). The format 
for identifying the wavelengths on a given link classified to a given service level is best 
provided by example. Specifically, SA (N1:N2) = lamda 1, 2 indicates that there is an 
optical link between Nl and N2, and that the wavelength parameters of lamda 1 and 
lamda 2 on that link qualify them for service level A (lamda 1 and 2 are referred to as 
the link service level channel set on link Nl :N2 for service level A). Using this format. 
Figure 2 illustrates the connectivity of service level A being: SA (N1:N2) = lamda 1, 2; 
SA (N2:N4) = lamda 1; SA (N4:N5) = lamda 1, 2; SA (N1:N3) = lamda 1, 2; SA 
(N3:N4) = lamda 1, 2. The service level connectivity for service level B is SB (Nl :N2) 
= lamda 3; SB (N2:N4) = lamda 3; SB (N4:N5) = lamda 3; SB (N1:N3) = X; and SB 
(N3:N4) = X (where X indicates a null set). The connectivity of service level C is: SC 
(Nl :N2) = lamda 4; SC (N2:N4) = lamda 5; SC (N4:N5) = lamda 4; SC (Nl :N3) = 
lamda 4; and SC (N3:N4) = lamda 4. 

[0063] Thus, while Figure 1 illustrates the connectivity at the physical link level. 
Figure 2 illustrates the connectivity for each service level (a service level topology for 
the network). Effectively, this service level node coimectivity divides the optical 
network into QoS based logical network views as illustrated. Thus, for a first access 
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node there are one or more paths across physical links to a second access node 
(physical topology). For any given one of these paths, there may be, on each of the 
link(s) making up that path, wavelengths at the same service level. For any given one 
of these paths, there may also be, on the link(s) making up that path, one or more of the 
same wavelengths at the same service level. 

[0064] Figures 3A-C illustrate the conversion free service level topologies for service 
levels A-C for Nl of the optical network in Figure 2 according to certain embodiments 
of the invention. Specifically, Figures 3 A-C illustrate conversion free service level 
topologies in the form of trees having Nl as the root with branches representing links 
from node to node through the network. As used below, the phrase "path service level 
channel set" refers to the intersection set of the link service level channel sets on the 
links of the path. For example, the path service level channel set for the path 
N1:N2:N4:N5 at service level A is the intersection set of the link service level channel 
sets SA (N1:N2), SA (N2:N4), and SA (N4:N5). 

[0065] Figure 3 A illustrates service level A's conversion free service level topology 
for Nl of the optical network in Figure 2 according to certain embodiments of the 
invention. In Figure 3 A, Nl has branches to N2 and N3. With regard to the branch to 
N2, both lamda 1 and lamda 2 are available at service level A. Thus, for the path from 
Nl to N2, lamda 1 and lamda 2 make up the path service level channel set for service 
level A. Similarly, for the branch from Nl to N3, the path service level channel set 
includes lamda 1 and 2. It should be noted that for paths between adjacent nodes, the 
link service level channel set (e.g., SA(N1 :N2) = lamda 1,2) is the same as the path 
service level channel set. 

[0066] From each of N2 and N3, there is a branch to a different representation of N4. 
The branch from N2 to N4 represents the path N1:N2:N4. Since the link service level 
channel sets for Nl :N2 and for N2:N4 respectively include lamda 1,2 and lamda 2, the 
intersection of these link service level channel sets includes only lamda 1 (the only 
conversion free Nl :N2:N4 path uses lamda 1 on both Nl :N2 and N2:N4). As such, the 
path service level channel set for the path Nl :N2:N4 includes only lamda 1 . In 
contrast, the branch from N3 to N4 represents the path Nl :N3:N4. Since the 
intersection of the link service level channel sets for N1:N3 and N3:N4 includes lamda 
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1 and 2, the path service level channel set for the path N1:N3:N4 includes lamda 1 and 
2. 

[0067] The branch from Nl to N4, through N2, branches to: 1) N3 with path service 
level channel set lamda 1 ;and 2) N5 with path service level channel set lamda 1 . The 
branch from Nl to N4, through N3, branches to: 1) N2 with path service channel set 
lamda 1; and 2) N5 with path service level channel set lamda 1,2. It should be noted 
that even though the link service level channel set for N4:N5 includes lamda 1,2, the 
path service level channel set for N1:N2:N4:N5 includes only lamda 1 to remain 
conversion free. This is in contrast to the path service level channel set for 
N1:N3:N4:NS which includes both lamda 1 and 2 because both are available on each 
link of this path. 

[0068] Figure 3B illustrates service level B's conversion free service level topology 
for Nl of the optical network in Figure 2 according to certain embodiments of the 
invention. Since there is no lamda that qualifies for service level B on the link Nl :N3, 
the tree of Figure 3B does not have a branch from Nl to N3. However, there is a 
branch from Nl to N2, and the path service level channel set for the branch from Nl to 
N2 includes lamda 3. N2 has a branch to N4, which branch has as its path service level 
channel set lamda 3. Since there is no lamda qualifying for service level B on the link 
from N4 to N3, there is not a branch from N4 to N3. However, there is a branch to N5, 
and the path service level channel set for Nl :N3:N4:N5 includes lamda 3. 

[0069] Figure 3C illustrates service level C's conversion free service level topology 
for Nl of the optical network in Figure 2 according to certain embodiments of the 
invention. The tree of Figure 3C has branches from Nl to: 1) N2 with path service 
level channel set lamda 4; and 2) N3 with path service level channel set lamba 4. There 
is no branch from N2 because wavelength conversion would be necessary (the link 
service level channel set for N2:N4 is lamda 5, whereas the path service level channel 
set for the path from Nl to N2 includes lamda 4). There is a branch from N3 to N4, 
which branch has as its path service level channel set lamda 4. There are branches 
from N4 to each of N2 and N5, both of which the path service level channel set 
includes lamda 4. 

[0070] It should be imderstood that a given topology for a node may be service level 
based and/or conversion free based (depending on the set of connectivity constraints 
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used). Thus, the phrase "service level topology'' for a node indicates that at least a QoS 
based criteria is used, but it does not exclude the use of conversion free criteria (except 
where otherwise indicated herein); likewise, the phrase "conversion free topology" for 
a node indicates that at least a conversion free criteria is used, but it does no exclude the 
use of a QoS based criteria (except where otherwise indicated herein). In other words, 
to say a topology for a node is service level based does not indicate whether or not it is 
also conversion free based; to say a topology for a node is conversion free based does 
not indicate whether or not it is also service level based; but to say a topology for a 
node is conversion free based and QoS based indicates it must be both. 

[0071] It should also be understood that if the set of connectivity constraints includes 
QoS based criteria, then there are service level topologies for the network and service 
level topologies (or conversion free service level topologies if a conversion free criteria 
is also used) for each node; if the set of connectivity constraints includes a conversion 
free criteria, then there is a conversion free topology (or a conversion free service level 
topology if QoS based criteria are also used) for each node. Different embodiments 
may store network topology databases that represent one or more of these different 
topologies in different devices depending on the implementation and the set of 
connectivity constraints used. For example, a centralized network management server 
may store network topology database(s) representing: service level topologies for the 
network, service level topologies for each node, one or more conversion free topologies 
for each node, and/or conversion free service level topologies for each node. As 
another example, each access node may store may store network topology database(s) 
representing: service level topologies for the network, service level topologies for that 
node, one or more conversion free topologies for that node, and/or conversion free 
service level topologies for that node. It should be understood that other configurations 
are within the scope of the invention. 

[0072] Figure 4 is a block diagram illustrating a hierarchy of terms according to 

certain embodiments of the invention. The terms illustrated in Figure 4 will be used 

with respect to certain embodiments of the invention described below. With reference 

to Figure 4, the network is divided into a set of one or more service levels, each service 

level includes a set of zero or more possible end to end paths, each of these possible 

end to end paths includes a set of one or more links, and each link includes one or more 

available lamdas. The possible end to end paths of a given service level are referred to 
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as the set of possible end to end service level paths (all paths that can be made between 
access nodes with the available lamdas at that service level). The union of the possible 
end to end service level paths of all the service levels is referred to as the set of possible 
end to end network paths. The links making up a given path are referred to as the set of 
path links, whereas the union of the links of all the possible end to end paths in a set of 
possible end to end service level paths is referred to as the set of service level links. 
The lamdas on a link of a possible end to end path of a service level are referred to as 
the link lamdas, whereas the union of the lamdas on the links of a possible end to end 
path of a service level are referred to as the path lamdas. The term service level link 
lamdas is used to refer to the links of the service level links and the lambas thereon 
qualifying for that service level. 

[0073] The hierarchy illustrated in Figure 4 provides a framework for the set of 
connectivity constraints including one or more QoS based criteria that divide the 
network into service levels. When the set of one or more coimectivity constraints also 
includes a conversion free constraint, the link lamdas of the links of a possible end to 
end path of a service level will all be the same. In other words, to provide a conversion 
free end to end path, the same lamda must be used on each link of the end to end path 
(that lamda must qualify for the same service level on each link of the path). In 
contrast, when the set of connectivity constraints does not include a conversion free 
constraint, the set of link lamdas may be different for different links of a possible end to 
end path of a service level. 

Building and Maintaining Network Topology Databases with a Set of Coimectivitv 
Constraints 

[0074] While various techniques are described with reference to the building and 
maintaining of network topology databases with a set of connectivity constraints, it is 
understood that this is an aspect of the invention independent of other aspects of the 
invention; thus, the invention is not limited to the exemplary techniques of building and 
maintaining network topology databases with a set of connectivity constraints as 
described herein. 
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Overview 

[0075] Figure 5 is a flow diagram for building and maintaining network topology 
databases with a set of connectivity constraints according to certain embodiments of the 
invention. It should be understood that different ones of the blocks in Figure 5 could be 
performed in a distributed and/or centrahzed manner as described in more detail below. 

[0076] In block 505, the lamdas for each link are tracked and control passes to block 
505. While certain embodiments of the invention use a link management protocol 
(LMP) to discover the adjacent links between nodes, alternative embodiments of the 
inventions may use other techniques (e.g., a manual input technique into each node, a 
manual input technique into a centralized network management server, etc.). In 
addition, while certain embodiments of the invention include a monitoring unit in one 
or more nodes of the network to measure wavelength parameters, altemative 
embodiments of the invention can use other techniques (e.g., periodic extemal testing 
devices, manual input into to each node of wavelength parameters, manual input of 
wavelength parameters into a centralized network management server, etc.). 

[0077] As shown in block 510, a classification by QoS criteria is maintained for the 
lamdas of each link to determine the service level link lamdas and control flows to 
block 515. While in certain embodiments block 510 is performed by each node for its 
adjacent links, altemative embodiments of the invention use an altemative technique 
(e.g., a centralized network management server performs block 510 responsive to 
receiving wavelength parameter information as discussed with reference to block 505). 

[0078] In block 515, the service level connectivity based on the conversion criteria is 
maintained for each service level. The service level connectivity that is maintained 
would include the available lamdas and the status as either allocated or unallocated. 
While in certain embodiments of the invention, the service level connectivity is built in 
distributed fashion and maintained in the access nodes, altemative embodiments of the 
invention use altemative techniques (e.g., perform such in a centralized network 
management server). The conversion criteria represents the number of wavelength 
conversions allowable for a given optical circuit. For example, if one of the 
connectivity constraints is a conversion free connectivity constraint, the number of 
wavelength conversions allowable is zero. 
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[0079] Figure 6 is a flow diagram illustrating the provisioning of lightpaths according 
to certain embodiments of the invention. Different embodiments of the invention may 
implement such provisioning using a source based, centralized, hybrid, or other 
provisioning scheme. 

[0080] In block 605, demand criteria is received. This demand criteria represents a 
request for a communication path (e.g., an optical circuit, a lightpath, a end-to-end uni- 
directional path, etc.). From block 605, control passes to block 610. hi certain 
embodiments of the invention using a source based scheme, the demand criteria is 
received by an access node in the optical network. In other embodiments of the 
invention using a centralized network management server, such demands are received 
by the network management server directly from the requestor and/or from an access 
node in the optical network receiving the demand criteria. Of course, alternative 
embodiments of the invention can use other schemes and/or implement the schemes in 
other ways. 

[0081] As shown in block 610, the service level is determined if it was not specified 
and control passes to block 615. For instance, while certain demand requests may 
come from entities aware of the service levels provided by the optical network, other 
entities making requests may not. These later entities may either not include any 
parameters or include parameters from which a service level can be determined. 

[0082] In block 615, it is detemiined if there is an end to end path available at the 
determined service level. If there is a path available, control passes to block 620. 
Otherwise, control passes to block 625. 

[0083] In block 620, a path and necessary lamda(s) are selected and allocated. The 
ntmiber of different wavelengths allocated will depend upon the wavelength conversion 
criteria (e.g., where a conversion free connectivity constraint is used, the same 
wavelength(s) will be used across each link of the selected path). Since this allocation 
affects the service level connectivity of block 515, block 515 is updated (e.g., some 
action is taken responsive to the allocation, periodic checks of the formed, etc.). In 
certain embodiments of the invention using a source based scheme, the source node 
performs block 620 by: 1) selecting the path and lamda(s); and 2) commimicating with 
the other nodes of the optical network to allocate. In other embodiments of the 
invention in which a centralized network management server is used, block 620 is 
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performed by a network management server performing the selection and 
communicating the allocation to the nodes on the path. Of course, alternative 
embodiments of the invention could implement other schemes in other ways, 

[0084] In block 625, alternative action is taken depending upon the manner in which 
the optical network is administered. For instance, one or more of the following may be 
options: using a path from a higher service level, muxing two or more paths from lower 
service levels, allocating a single path from a lower service level, denying, allowing for 
an increased amount of wavelength conversions to occur, etc. 

[0085] In addition to the need to allocate responsive to demand criteria, other 
operations are performed as part of administration of the optical network (e.g., 
deallocation, addition of a new wavelength, addition of a new link, failure/restoration 
of a wavelength, failure/restoration of a link, failure/restoration of a node, etc.). One or 
more blocks of Figure 5 are updated responsive to these changes in order to provide for 
a current view the optical network. For instance, if a request was made to deallocate a 
path, the node that initiated the allocation (source) is instructed to deallocate the path 
and block 515 updates the service level connectivity of the service level, including the 
path that was deallocated. The addition of a wavelength, link or node (as well as the 
removal of a wavelength, link, or a node which was carrying no live traffic) results in 
an updating through blocks 505, 510 and 515. The loss of a wavelength, link or node is 
treated as a failure upon which some action is taken depending upon the redimdancy 
scheme being implemented (different embodiments of the invention can use different 
redundancy schemes) or an elimination of that wavelength, link or node from the 
network. 

[0086] It should also be noted that a request to change the demand criteria for a given 
provisioned service (e.g., a request to lower or raise the service level of a given 
provisioned service) is also addressed by certain embodiments of the invention. In 
particular, certain such embodiments respond to such requests by allocating a new path, 
and if successfiil and necessary, moving the traffic from the old path to the new 
allocated path and deallocating the old path. While different embodiments can perform 
the above using of variety of different techniques, embodiments using a source based 
scheme are discussed by way of example, and not by limitation, below. 
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[0087] Of course, one or more parts of an embodiment of the invention may be 
implemented using any combination of software, firmware, and/or hardware. Such 
software and/or firmware can be store and communicated (internally and with other 
access nodes over the network) using machine-readable media, such as magnetic disks; 
optical disks; random access memory; read only memory; flash memory devices; 
electrical, optical, acoustical or other form of propagated signals (e.g., carrier waves, 
infirared signals, digital signals, etc.); etc. 

Exemplarv Distributed Search Technique 
[0088] Certain embodiments of the invention will now be described with reference to 

a distributed search based technique for building and maintaining in source nodes 

network topology databases based on a set of connectivity constraints that includes QoS 

criteria and conversion firee constraints. However, it should be understood that 

alternative embodiments may use a distributed technique, but not build and maintain 

the service level topology databases in the source nodes (e.g., they may be built and 

maintained in a centralized network management server). In addition, while a 

distributed search based technique is described, altemative embodiments can use 

alternative techniques (e.g., a centralized technique). Similarly, altemative 

embodiments of the invention may not include the conversion free connectivity 

constraint, or relax it when necessary (e.g., when there is no conversion free end to end 

path at the requested service level). 

[0089] Figure 7 is a block diagram illustrating an exemplary access node according to 
certain embodiments of the invention. Figure 7 shows a control plane 700 coupled with 
a data plane 701. The control plane 701 includes node databases 702 coupled with 
node modules 735. Of course, the control plane 700 includes other items (e.g., 
protocols). 

[0090] Figure 7 shows the node databases 702 include a service level connectivity 
database 705, a service level parameter database 710, a link state database 715, and a 
routing database 720. The link state database 715 includes a set of one or more link 
state structures 725, one for each link connected to that node. While in certain 
embodiments these links are discovered through a link management protocol, 
altemative embodiments could use other techniques as described above. Each link state 
stmcture records a neighboring node, a port through which that neighboring node is 
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connected (fiber links end up at a port on the node), available wavelengths on that link 
(through the port), as well as each wavelength's parameters. 

[0091] The service level parameter database 710 stores the service level parameters 
previously discussed herein. The service level connectivity database includes a set of 
one or more service level topology structures 730, one for each service level. Each of 
these service level topology structures stores a representation of the conversion free 
service level topology for that node (e.g., see Figures 3A-C). In addition, the service 
level topology structxire for each service level would track the allocated/unallocated 
status for each lamda in its topology. The status may not be limited to being allocated 
or unallocated. For example, a lamba that has failed due to a fiber cut, could be 
assigned a status of "broken". For embodiments in which only bi-directional paths can 
be allocated, the granularity for tracking allocated/unallocated status is simply the 
lamda level. However, in embodiments that allow for imidirectional path allocation, 
the granularity of allocated/unallocated status is a status for each direction for each 
lamda. 

[0092] The node modules 735 includes a start up module 740, a connectivity request 
module 745, an allocate module 750, a Deallocate module 755, and an add/remove 
module 760. The operation of these modules in certain exemplary embodiments will be 
described respectively with respect to figures 9-10, 11, 12-14, 15-16, and 17-18. 

Startup 

[0093] Figure 8 is an exemplary data flow diagram of a distributed search based 
technique's formation of service level A's service level topology for Nl of the optical 
network in Figure 2 according certain embodiments of the invention. Figure 9-1 1 are 
flow diagrams for a distributed search based technique for building service level 
topologies, using a set of connectivity constraints including QoS criteria and conversion 
free criteria, in access nodes of an optical network. To provide an example. Figures 9- 
1 1 will be described with reference to the exemplary data flow diagram of Figure 8. 
The operations of this and other flow diagrams will be described with reference to the 
exemplary embodiments of the other diagrams. However, it should be understood that 
the operations of the flow diagrams can be performed by embodiments of the invention 
other than those discussed with reference to these other diagrams, and the embodiments 
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of the invention discussed with reference these other diagrams can perform operations 
different than those discussed with reference to the flow diagrams. 

[0094] Figure 9 is a flow diagram performed by each access node when joining an 
optical network according to embodiments of the invention. This flow diagram begins 
responsive to provision of wavelength parameters and service level parameters (905). 
With reference to the databases in Figure 7, this would occur responsive to the 
populating of the service level parameter database 710 and the link state database 715. 
In certain embodiments, the service level parameter database is populated by the 
service provider through the network management interface. 

[00951 In block 910, the number of service levels are determined and control passes 
to block 915. In certain embodiments of the invention, block 910 is performed by 
parsing the service level parameter database. 

[0096] As shown in block 915, for each link to an adjacent node, the lamdas on that 
link are classified by the service level parameters to form link service level channel 
sets. With reference to Figure 8, the link service level channel set for service level A 
for each node shown in Figure 8 is illustrated by a box next to that node. From block 
915, control passes to block 920. 

[0097] In block 920, a service level topology build-up is initiated for each service 
level. 

[0098] Figure 10 is a flow diagram illustrating a service level topology build-up for a 
single service level according to embodiments of the invention. Thus, the flow of 
Figure 10 would be performed for each service level responsive to block 920. 

[0099] In block 1005, a service level topology structure is instantiated and populated 
with any qualifying adjacent nodes (adjacent nodes for which this source node has any 
non-null link service channel sets at this service level) and control passes to block 
1010. With reference to Figure 8, Nl would instantiate a service level topology 
structure 730 in its service level connectivity database 705. The service level topology 
stracture would include at its root Nl, as well as a branch to each of N2 and N3. 

[00100] As shown, in block 1010, connectivity request message(s) are transmitted to 
the qualifying adjacent node(s) and control passes to block 1015. In certain 
embodiments of the invention, each connectivity request message includes a request 
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ED, a source node ID, a forward node ID, a service level, and a computed set (a set of 
one or more paths, as well as the path service level channel set for each). While all of 
these fields are not needed for block 1010 (e.g., the source node is the same as the 
forward node, the needed inforaiation in the computed set is already known by the 
adjacent nodes), they are used as the search moves through the network (see figure 11). 
While in certain embodiments of the invention each connectivity request message 
includes the above noted fields, alternative embodiments could be implemented other 
ways (e.g., while fiiU versions of connectivity request message could be used for figure 
11, reduced versions of connectivity request messages could be used for block 1010; 
such reduced versions could include simply the request ID, source node ID, and service 
level). With respect to Figure 8, Nl transmits a connectivity request message to each of 
N2 and N3 (the source node ID is Nl, and the service level is A). 

[00101] In block 1015, the service level topology structure is updated responsive to 
connectivity response messages received. The nodes transmitting such connectivity 
response messages and the contents of such connectivity response messages are 
described later herein with respect to Figure 1 1 . For instance, upon receipt of a 
connectivity response message, the received data is added to the appropriate branch of 
the appropriate service level topology structure. Upon receipt of a connectivity stop 
message, the path, identified in the received message, of the service level topology 
structure, for the service level identified in the received message, is complete. With 
respect to the example optical network described herein, the service level topology 
structure for service level A would represent something similar to that shown in Figure 
3 A. For example, in certain embodiments of the invention a table is maintained with 
each of the available paths and its corresponding path service level channel set (e.g., 
each entry in the table store one of the available paths and its corresponding path 
service level channel set). 

[00102] Figure 1 1 is a flow diagram illustrating operations performed by nodes 
responsive to a connectivity request message received over a link according to certain 
embodiments of the invention. With respect of Figure 8, node N2 receives the 
connectivity request message fi-om node Nl. 

[00103] In block 1 1 10, it is determined if the connectivity request message was 
previously processed. If so, control passes to block 1 1 15; at which point this flow is 
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complete. Otherwise, control passes to block 1 120. A connectivity request message 
could have been previously processed because it was received from a different adjacent 
node. The determination as to whether a connectivity request message was previously 
processed could be performed in a number of different ways. For example, in an 
embodiment in which connectivity request messages include the request ID and the 
source node ID, this determination can be made by comparing this request ID and 
source node ID of the current connectivity request message to a log of such for 
previous connectivity request messages. 

[00104] As shown in block 1 125, the intersection of the received path service level 
channel set for the path to this node with the link service level channel set for each 
propagation port is determined. From block 11 25, control passes to block 1 130. The 
phrase propagation port is used to refer to any ports other than: 1) the one the 
connectivity request message was received on; and 2) a port connected to the source 
node (i.e., the source node is adjacent to this node). In certain embodiments of the 
invention, the propagation ports are determined by selecting links from the link state 
database that are not connected to the forward node ID and source node ID identified in 
the connectivity request message. With reference to Figure 8, since N2 received the 
connectivity request over the link to Nl and since Nl is the source node, N2 would 
select the port through which a link to node N4 is connected. N2 would then determine 
the intersection of the path service level channel set for Nl :N2 with the link service 
level channel set for N2:N4. This intersection set is the path service level channel set 
for Nl :N2:N4 and is included in the computed set (path service level channel sets are 
shown in Figure 8 by dashed boxes, such as the one under N2). Specifically, N2 
determines the intersection of the path service level channel set (SA (Nl :N2) = lamda 
1, 2) and the link service level channel set (SA (N2:N4) = lamda 1) to be lamda 1 
(which is also represented herein using the format SA (Nl :N2:N4) = lamda 1). 

[00105] Thus, the computed set represents the intersection of the preceding link 
service level channel sets for the path the connectivity request message has traveled. In 
the case of block 1010, the computed set is the same as the link service level channel 
set for the link over which the connectivity request message W2is transmitted. However, 
as the connectivity request message gets retransmitted to other nodes, the computed set 
will represent the paths traveled and the intersection set for each such path. 
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[00106] In block 1 130, it is determined if there are any non-null intersection sets. If 
so, control passes to block 1 140. Otherwise, control passes to block 11 35. 

[00107] As shown in block 1 140, a connectivity response message, with the 
intersection set(s) as path service level channel set(s), is transmitted to the source node 
and control passes to block 11 45. In certain embodiments of the invention, each 
connectivity response message includes the service level, request ID, response node ID, 
and computed set. With regard to node N2, N2 would transmit to Nl a connectivity 
response message including as the computed set N1:N2:N4, lamda 1. 

[00108] In block 1 145, a connectivity request message, with the intersection set(s) as 
path service level channel set(s), is transmitted on the propagation ports and control 
passes to block 1115. With regard to node N2, N2 would transmit to N4 a connectivity 
request message. With regard to embodiments of the invention in which connectivity 
request messages include request ID, a source node ID, a forward node ID, a service 
level, and a computed set, N2 would respectively fill these fields with the request ID, 
Nl, N2, A, and the computed set Nl :N2:N4, lamda 1. 

[00109] In block 1 135, a connectivity stop message is transmitted back to the source 
node and control passes to block 1115. In certain embodiments, such a connectivity 
stop message includes the source node ID. 

[00110] To complete the example of Figure 8, responsive to the connectivity request 
message fi'om Nl, N3 determines the intersection set to N4 for service level A. N3 
transmits this intersection set back to Nl in a connectivity response message, as well as 
to N4 in a connectivity request message. Meanwhile, responsive to N2's connectivity 
request message, N4 determines intersection sets to N3 and N5 for service level A. N4 
transmits these back to Nl in a connectivity response message and transmits these to 
N3 and N5 in connectivity request messages. Responsive to N4's connectivity request 
messages: 1) N3 does nothing because it has seen this request ID before (the above 
connectivity request message from Nl); and 2) N5 transmits back to Nl a connectivity 
stop message. Responsive to N3's connectivity request message, N4 does nothing 
because it has seen this request ED before (the above connectivity request message from 
N2). 

Allocate 
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[00111] Figures 12-14 are flow diagrams illustrating the allocation of a path according 
to certain embodiments of the invention. Figure 12 is the flow diagram illustrating 
operations performed by an access node to allocate a path according to certain 
embodiments of the invention. The operations in Figure 12 result in: 1) update routing 
database message(s) being sent to the nodes along the selected path being allocated; 
and 2) update allocate channel message(s) being sent to certain nodes that are on that 
path. Figure 13 is a flow diagram illustrating the operations performed by an access 
node responsive to an update routing database message according to certain 
embodiments of the invention; Figure 14 is a flow diagram illustrating the operations 
performed by an access node responsive to an update allocate channel message 
according to certain embodiments of the invention. 

[00112] With reference to Figure 12, an access node (which will act as the source 
node) receives a demand for a path and control passes to block 1210. There are various 
mechanisms through which such a demand for a path could be received by the access 
node. For instance, in certain embodiments of the invention OIF-UNI and/or OIF-NNI 
interfacing protocols are used to communicate with nodes and domains, respectively, 
which do not support GMPLS or MPLS, 

[00113] In block 1210, the service level and destination node for the demand are 
determined and control passes to block 1220. Block 1210 may be performed in a 
similar manner to block 605 of Figure 6. 

[00114] As shown in block 1220, it is determined if there is a path available at that 
service level. If not, control passes to block 1225. Otherwise, control passes to block 
1230. Block 1220 can be implemented in a variety of ways. With regard to the 
exemplary embodiment of Figure 7, the service level topology structure is parsed to 
determine if the destination node is reachable and there is an imallocated lamda 
available. While in certain embodiments, the service level topology structure is parsed 
responsive to a demand, alternative embodiments of the invention generate derivative 
structures that are faster to parse and/or pre-select (and may pre-allocate) various paths 
(e.g., see discussion later herein). Block 1220 is similar to block 615 of Figure 6. 

[00115] As shown in block 1225, alternative action is taken. Block 1225 is similar to 
block 625, and the various altematives discussed there are equally applicable here. 
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[00116] In block 1230, a path and channel are selected based upon selection criteria 
and control passes to block 1235. In certain embodiments, the selection of path and 
channel includes the selection of a node: channel: port sequence for the path (it should 
be noted that where, as here, a conversion-free connectivity constraint is used, a single 
channel is used). Various embodiments can use different selection criteria for selecting 
the path and channel. For instance, certain embodiments of the invention utilize load 
balancing as described later herein. It should also be understood that various path 
calculation techniques may be used, including Djikstra's algorithm. 

[00117] As shown in block 1235, the routing database is updated and control passes to 
block 1240. The routing database is updated to reflect the connection of the incoming 
port identified by the demand in block 1205 with the outgoing channel: port of the 
selected path. In certain embodiments, responsive to the updating the routing database, 
well-known techniques are used to modify the data plane of the access node 
accordingly (of course, alternative embodiments may be implemented to modify the 
data plane first and/or through a different mechanism). Whether a path in the opposite 
direction is also allocated depends on whether the implementation requires all paths to 
be bi-directional and/or a bi-directional path v/as requested in the demand. 

[00118] In block 1240, update routing database message(s) are transmitted to nodes on 
the selected path and control passes to block 1245. In certain embodiments of the 
invention, each update routing database message includes an update ID, as well as the 
channel and port information relevant to the recipient node of the message. 

[00119] As shoAvn in block 1245, the selected service level topology structure is 
updated and control passes to block 1250. In particular, the selected channel is marked 
as allocated in all path service level channel sets down stream of a link in the selected 
path. In other words, the selected channel is marked allocated in the path service level 
channel set(s) of the available path(s) that include one or more links of the selected 
path. To provide an example, assume the path Nl : N2: N4 is allocated with lamda 1 in 
Figure 2. With reference to Figure 3A, lamda 1 would need to be marked as allocated 
from the path service level channel set of Nl : N2, Nl : N2: N4, Nl : N2: N4: N3, Nl : 
N2: N4: N5, and Nl: N3: N4: N2 because each contains one or more links on the 
selected path. 
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[00120] In block 1250, an update allocate channel message is transmitted to nodes in 
the selected service level topology structure. In certain embodiments, each update 
allocate channel message includes an update ED, a service level, a path, an allocated 
channel, and a sent-to-set. The sent-to-set represents the set of nodes to which the 
message is going to be sent. While the nodes to which the message is to be sent can be 
determined in a variety of ways, certain embodiments of the invention parse the service 
level topology structure to identify all of the nodes (removing duplicates) apart from 
the source node. 

[00121] Figure 13 is a flow diagram illustrating operations performed by an access 
node responsive to an update routing database message according to certain 
embodiments of the invention. In block 1310, the routing database is updated. The 
receiving node's routing database is updated to reflect the connection identified in the 
received message. In certain embodiments, responsive to the updating of the routing 
database, well-known techniques are used to modify the data plane of the access node 
accordingly (of course, alternative embodiments may be implemented to modify the 
data plane first and/or through a different mechanism - e.g., signaling). 

[00122] Block 1310 is performed in a similar fashion to block 1235 of Figure 12. 

[00123] Figure 14 is a flow diagram illustrating operations performed by an access 
node responsive to an update allocate channel message according to certain 
embodiments of the invention. In block 1410, it is determined if any of the available 
paths of the service level topology structure for the service level of the allocated path 
contain one or more links of the selected path. If not, control passes to block 1415 
where the flow diagram ends. If so, control passes to block 1420. In certain 
embodiments of the invention, block 1410 is performed by parsing the appropriate 
service level topology structure to determine if any links on the selected path are 
represented therein. 

[00124] As shown in block 1420, it is determined if any of the path service level 
channel set(s) of the available paths identified in block 1410 include the allocated 
wavelength. If not, control passes to block 1415. Otherwise, control passes to block 
1425. In certain embodiments of the invention, block 1420 is performed by parsing the 
path service level channel set(s) of the identified path(s) to determine if the allocated 
wavelength is present. 
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[00125] As shown in block 1425, the selected service level topology structure is 
updated and control passes to 1430. In certain embodiments of the invention, block 
1425 is performed by marking the allocated wavelength as allocated in the path service 
level channel set(s) identified in block 1420. 

[00126] As shown in block 1430, nodes are selected from the service level topology 
structure that are not identified in the received allocate channel message and control 
passes to block 1435. In certain embodiments of the invention, block 1430 is 
performed by: 1) identifying as "new set" all of the nodes in the service level topology 
structure that are not in the sent-to-set in the received update allocate channel message 
(1405); and 2) forming an updated version of the sent-to-set that is the imion of the new 
set and the sent-to set in the received update allocate channel message (1405). 

[00127] In block 1435, an update allocated channel message is transmitted to the 
selected nodes. In certain embodiments of the invention, block 1435 is performed by 
transmitting an update allocate channel message with the updated sent-to-set to all 
nodes in the new set of block 1430. 

Deallocate 

[00128] Responsive to a request to deallocate a channel (e.g., communication received 
by the source node for the path using the channel), signaling is used to disconnect the 
existing cross connects on the path. Figure 15 is a flow diagram illustrating operations 
performed by the source node of a path responsive to that path being deallocated 
according to certain embodiments of the invention. As part of the flow diagram in 
Figure 15, the source node of the path transmits update deallocate channel message(s) 
to certain other nodes. Figure 16 is a flow diagram illustrating the operations 
performed by access nodes responsive to receiving an update deallocate channel 
message according to certain embodiments of the invention. 

[00129] In block 1510, the service level of the channel being deallocated is determined 
and control passes to block 1515. In certain embodiments, the service level is 
determined by parsing the link state database to locate the channel being deallocated. 

[00130] As shown in block 1520, the service level topology structure is updated and 
control passes to block 1525. Block 1520 is performed in a similar fashion to block 
1245, with the exception that the channel is marked unallocated. In particular, the 
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deallocated channel is marked as unallocated in all path service level channel sets down 
stream of a link in the deallocated path. In other words, the deallocated channel is 
marked imallocated in the path service level channel set(s) of the available path(s) that 
include one or more links of the deallocated path. To provide an example, assume the 
path Nl : N2: N4 is deallocated with lamda 1 in Figure 2. With reference to Figure 3 A, 
lamda 1 would need to be marked as unallocated from the path service level channel set 
of Nl : N2, Nl : N2: N4, Nl : N2: N4: N3, Nl : N2: N4: N5, and Nl : N3: N4: N2 
because each contains one or more links on the deallocated path. 

[00131] As shown in block 1525, an update deallocate channel message is transmitted 
to nodes in the service level topology structure and control passes to block 1530. The 
set of nodes to which this message is sent is referred to the sent-to-set. In certain 
embodiments of the invention, the update deallocate channel message includes the 
soiirce node ID, the adjacent node ED, the path, the channel deallocated, the update ID, 
the service level, and the sent-to-set. While the nodes to which the message is to be 
sent can be determined in a variety of ways, certain embodiments of the invention parse 
the service level topology structure to identify all of the nodes (removing duplicates) 
apart from the source node. 

[00132] As shown in block 1530, the routing database is updated and control passes to 
block 1540. With reference to the exemplary embodiment of Figure 7, the routing 
database 720 would be modified to remove the connection of the deallocated chaimel. 
Whether a path in the opposite direction is also deallocated depends on whether the 
implementation requires all paths to be bi-directional and/or the path being deallocated 
was bi-directional. 

[00133] In block 1 540, update routing database message(s) are transmitted to nodes on 
the selected path. In certain embodiments of the invention, each update routing 
database message includes an update ID, as well as the chaimel and port information 
relevant to the recipient node of the message. A recipient access node responds to the 
receipt of such a message by modifying its routing database to reflect the disconnection 
of the incoming chaimel:port and the outgoing chaimel: port as specified in the 
message. 
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[00134] In this manner, the nodes along the path are updated to reflect the 
deallocation; in addition, update deallocate channel messages have been sent to initiate 
any necessary updating at such nodes. 

[00135] Figure 16 is a flow diagram illustrating operations performed by access nodes 
responsive to an update deallocate channel message according to certain embodiments 
of the invention. In block 1 6 1 0, it is determined if any of the available paths of the 
service level topology structxire for the service level of the deallocated path contain one 
or more links of the deallocated path. If not, control passes to block 1615 where the 
flow diagram ends. If so, control passes to block 1620. In certain embodiments of the 
invention, block 1610 is performed by parsing the appropriate service level topology 
structure to determine if any links on the deallocated path are represented therein. 

[00136] As shown in block 1620, it is detemiined if any of the path service level 
channel set(s) of the available paths identified in block 1610 include the deallocated 
wavelength. If not, control passes to block 1615. Otherwise, control passes to block 
1625. In certain embodiments of the invention, block 1620 is performed by parsing the 
path service level channel set(s) of the identified path(s) to determine if the allocated 
wavelength is present. 

[00137] As shown in block 1625, the selected service level topology structure is 
updated and control passes to 1630. In certain embodiments of the invention, block 
1625 is performed by marking the deallocated wavelength as unallocated in the path 
service level channel set(s) identified in block 1620. 

[00138] In block 1630, the nodes in the service level topology structure that are not 
identified in the received update deallocate channel message are selected and control 
passes to block 1635. In certain embodiments of the invention, block 1630 is 
performed by: 1) identifying as "new set" all nodes in the service level topology 
structure that are not in the sent-to-set in the received update deallocate channel 
message (1605); and 2) forming an updated version of the sent-to-set that is the union 
of the new set and the sent-to-set in the received update deallocate chaimel message 
(1605). 

[00139] As shown in block 1635, an update deallocate channel message is sent to the 

selected nodes and control passes to block 1615. In certain embodiments of the 

invention, this update deallocate channel message includes the new sent-to-set 
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determined in block 1630 as opposed to the sent-to-set in the received update deallocate 
channel message (1605). 

Dynamic Provisioning 
[00140] As previously noted, a request to change the demand criteria for a given 
provisioned service (e.g., a request to lower or raise the service level of a given 
provisioned service) is also addressed by certain embodiments of the invention. In 
particular, certain such embodiments respond to such requests by allocating a new path, 
and if successful and necessary, moving the trafjfic from the old path to the new 
allocated path and de-allocating the old path. 

[00141] The reduced network topology database size (as compared to a physical 
network topology database) and distributed nature of this source based scheme allows 
for the provisioning of optical circuits in real-time (or on the fly; that is, the demands 
do not need to know ahead of time). Furthermore, the QoS based criteria allows for 
differentiation of traffic types at the optical layer. Thus, for example, a given service to 
a customer can be at a higher service level during the day, and dropped down to the 
lower service level at night. Of course, such switches can occur even more often. 

[00142] In addition, implementations can push SONET out to the edge of the network. 
For instance, as opposed to carrying stacks of network layers (IP over ATM over 
SONET) over optical, network layers can be directly carried over optical (e.g., IP or 
ATM, or SONET). 

Add and Remove Channels 
[00143] Figures 17 and 18 are flow diagrams illustrating operations performed when 
either a channel is added or a channel without live traffic is removed according to 
certain embodiments of the invention. The operations of Figure 17 are performed by 
the access nodes cormected by the link on which the channel is added or removed (also 
referred to as the adjoining nodes or the access nodes made adjacent by that link). As 
part of these operations, an update add/remove chaimel message is transmitted to 
certain other nodes. The operations of Figure 18 are performed by an access node 
responsive to such an update add/remove channel message. 

[00144] Figure 17 is a flow diagram illustrating the operations performed by the 
access nodes cormected by the link on which the chaimel is added/removed according 
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to certain embodiments of the invention. In block 1710, the service level of the channel 
is determined and control passes to block 1715. When a channel is being added, block 
1710 is performed, according to certain embodiments of the invention, by comparing 
that channel's wavelength parameters to the service level parameters to classify it into 
one of the service levels. When a channel is being removed, block 1710 is performed, 
according to certain embodiments of the invention, by accessing the link state database 
of Figure 7. 

[00145] As shovra in block 1715, a connectivity request message is transmitted on the 
link carrying the channel and control passes to blocks 1720 and 1725. Block 1715 is 
performed in a similar manner to block 1515 of Figure 15. 

[00146] In block 1720, the service level topology stmcture is updated responsive to 
connectivity response messages received. In certain embodiments of the invention, 
block 1720 is performed in a similar manner to block 1015 of Figure 10 with a 
variation. Since certain data already exists in the service level topology structure, the 
received data in the connectivity response messages is used to update (add, remove, 
and/or alter) the existing service level topology structure. In the case of a channel 
removal, in certain embodiments of the invention, the channel on each path with the 
link may be either removed from the service level topology structure or marked broken. 

[00147] As shown in block 1725, an update add/remove channel message is 
transmitted to the nodes in the service level topology structure that are not on the link 
with the chaimel. In certain embodiments of the invention, each update add/remove 
channel message includes an update ID, the wavelength, whether this is an addition or 
removal, the source node ID, the source adjacent node ID, the service level, and the 
sent-to-set. The source node and the source adjacent node identified are the access 
nodes connected by the link on which the channel was added/removed. The sent-to-set 
includes the nodes in the service level topology structure that the message is sent to in 
block 1725 (all nodes in the service level topology structure other than the source node 
and source adjacent node). 

[00148] Figure 1 8 is a flow diagram illustrating the operations performed by an access 
node responsive to receiving an update add/remove channel message according to 
certain embodiments of the invention. As shown in block 1810, it is determined if the 
service level topology structure includes path(s) with the link to which the channel was 
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added/removed. If not, control passes to block 1815 where the flow diagram ends. If 
so, control passes to block 1820. In certain embodiments of the invention, block 1810 
is performed by searching the service level topology structure (for the service level 
identified in the received update add/remove channel message) for the link identified in 
the received update add/remove channel message (based on the source node ID and 
source adjacent node ID contained therein), 

[00149] In block 1820, connectivity request message(s) are transmitted on link(s) of 
these paths and control passes to blocks 1825 and 1830. In particular, the access node 
transmits a connectivity request message on each of its links that are part of these paths. 

[00150] In block 1825, the service level topology structure is updated responsive to 
connectivity response messages received. Block 1825 is performed in a similar fashion 
to block 1720 of Figure 17, 

[00151] As shown in block 1 830, nodes are selected from the service level topology 
structure that are not identified in the received update add/remove channel message and 
control passes to block 1835. In certain embodiments of the invention, block 1830 is 
performed by: 1) identifying as "new set" all of the nodes in the service level topology 
structure that are not in the sent-to-set in the received update add/remove channel 
message (1805); and 2) forming an updated version of the sent-to-set that is the xmion 
of the new set and the sent-to set in the received update add/remove channel message 
(1805). 

[00152] In block 1835, an update add/remove channel message is transmitted to the 
selected nodes. As before, this update add/remove channel message will: 1) identify 
whether this is an addition or removal; and 2) include the updated sent-to-set as 
opposed to the sent-to-set in the received update add/remove channel message (1805). 

[00153] With regard to the removal of a channel with live traffic, the flow in Figures 
17 and 18 is followed with some variation. In particular, each involved access node 
(the access nodes connected by the link with the channel and the access nodes that 
receive an update add/remove channel message), determines if they are the source node 
of any allocated path(s) that includes the link and uses the removed channel. If so, that 
access node executes a redundancy (protection) scheme. 



Link Removal 
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[00154] When a link is removed (e.g., it fails or is permanently removed) between two 
nodes within the network, all the channels on that link are lost. While certain 
embodiments perform the channel removal operations of Figures 17 and 18 for each 
such channel, other embodiments of the invention reduce the number of messages 
generated by addressing the link as a whole. In particular, figures 19 and 20 are flow 
diagrams illustrating operations performed when a link is removed according to certain 
embodiments of the invention. The operations of Figure 19 are performed by the 
access nodes connected by the link (also referred to as the adjoining nodes or the access 
nodes made adjacent by that link). As part of these operations, a link removal message 
is transmitted to certain other nodes. The operations of Figure 20 are performed by an 
access node responsive to such a link removal message. 

[00155] Figure 19 is a flow diagram illustrating the operations performed by the 
access nodes connected by the removed link according to certain embodiments of the 
invention. Block 1910 is used to indicate that the following blocks are performed for 
each service level. 

[00156] As shown in block 1915, it is determined if the service level topology 
structure includes path(s) with the removed link. If not, control passes to block 1930. 
If so, control passes to block 1925. In certain embodiments of the invention, block 
1915 is performed by searching the service level topology structure for the presence of 
the removed link. 

[00157] In block 1925, the service level topology structure is updated and control 
passes block 1930. In certain embodiments of the invention, any of the channels in 
these path's path service level channel set(s) that are in common with the link service 
level channel set of the removed link are marked broken (indicating that the channel(s) 
cannot be used). While in certain embodiments of the invention channels marked 
broken are maintained indefinitely, other embodiments of the invention delete such 
marked channels (and corresponding paths) after a period of time if the link is not 
reestablished. In other embodiments of the invention, these path(s) and channels are 
simply deleted immediately and added back in (see the link addition section) if they are 
reestablished. 

[00158] As shown in block 1930, a link removal message is transmitted to the nodes in 
the service level topology structure that are not on the link. In certain 
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embodiments of the invention, each Hnk removal message includes the link service 
level channel set of the removed link, the source node ID, the source adjacent node ID, 
an update ID, the service level, and the sent-to-set. The source node and the source 
adjacent node identified are the access nodes connect to the removed link. The sent-to- 
set includes the nodes in the service level topology stmcture that the message is sent to 
(all nodes in the service level topology structure other than the soiu-ce node and source 
adjacent node). 

[00159] Figure 20 is a flow diagram illustrating the operations performed by an access 
node responsive to receiving a link removal message according to certain embodiments 
of the invention. As shown in block 2010, it is determined if the service level topology 
structure includes path(s) with the removed link. If not, control passes to block 2020. 
If so, control passes to block 2015. In certain embodiments of the invention, block 
2010 is performed by searching the service level topology structure (for the service 
level identified in the received link removal message) for the link identified in the 
received link removal message (based on the source node ID and source adjacent node 
ID contained therein). 

[00160] In block 2015, the service level topology structure is updated and control 
passes block 2020. In certain embodiments of the invention, any of the channels in 
these path's (identified in block 2010) path service level channel set(s) that are in 
common with the link service level channel set of the removed link are marked broken 
(indicating that the channel(s) cannot be used). While in certain embodiments of the 
invention channels marked broken are maintained indefinitely, other embodiments of 
the invention delete such marked channels (and corresponding paths) after a period of 
time if the link is not reestablished. In other embodiments of the invention, these 
path(s) and channels are simply deleted immediately and added back in (see the link 
addition section) if they are reestablished. 

[00161] As shown in block 2020, nodes are selected from the service level topology 
structure that are not identified in the received link removal message and control passes 
to block 2025. In certain embodiments of the invention, block 2020 is performed by: 1) 
identifying as "new set" all of the nodes in the service level topology structure that are 
not in the sent-to-set in the received link removal message (2005); and 2) forming an 
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updated version of the sent-to-set that is the union of the new set and the sent-to set in 
the hnk removal message (2005). 

[00162] In block 2025, an link removal message is transmitted to the selected nodes. 
As before, this link removal message will include the updated sent-to-set as opposed to 
the sent-to-set in the received link removal message (2005). 

[00163] With regard to the removal of a link with live traffic, the flow in Figures 19 
and 20 is followed with some variation. In particular, each involved access node (the 
access nodes connected by the removed link and the access nodes that receive the link 
removal message), determines if they are the source node of any allocated path(s) that 
includes the Hnk. If so, that access node executes a redxmdancy (protection) scheme. 

Link Addition 

[00164] When a link is added, the LSD is updated in the access nodes connected to the 
link (e.g., in certain embodiments of the invention, LMP recognizes the new link). 
When a link is added between two nodes within the network, a number of channels on 
that link can be available all at once. While certain embodiments perform the channel 
addition operations of Figures 17 and 18 for each such chaimel, other embodiment of 
the invention reduce the number of messages generated by addressing the link as a 
whole. In particular, figures 21 and 22 are flow diagrams illustrating operations 
performed when a link is added according to certain embodiments of the invention. 
The operations of Figure 21 are performed by the access nodes connected by the link 
(also referred to as the adjoining nodes or the access nodes made adjacent by that link). 
As part of these operations, a link addition message is transmitted to certain other 
nodes. The operations of Figure 22 are performed by an access node responsive to such 
a link addition message. 

[00165] Figure 21 is a flow diagram illustrating the operations performed by the 
access nodes connected by the added link according to certain embodiments of the 
invention. In block 2107, the wavelength(s) on the added link are classified by service 
level parameters to form link service level channel set(s) and control passes to block 
2110. In certain embodiments of the invention, block 2107 is performed in a similar 
manner to block 915, with the exception that only the added link is processed. 
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[00166] Block 21 10 is used to indicate that the following blocks are performed for 
each service level to which new channels were added (those service levels for which 
the link service level channel set of the added link is not null). 

[00167] As shown, in block 2115, connectivity request message(s) are transmitted to 
the qualifying adjacent node(s) and control passes to blocks 2120 and 2125. In certain 
embodiments, block 21 15 is performed in a similar manner to block 1010. 

[00168] In block 2120, the service level topology structure is updated. In certain 
embodiments of the invention, block 2120 is performed in a similar manner to blocks 
1005 and 1015 of Figure 10 with a variation. With regard to the variation on block 
1005, the service level topology structure is populated with the access node made 
adjacent by the added link (the service level topology structure was already populated 
with any other adjacent nodes). With regard to the variation on block 1015, since 
certain data already exists in the service level topology structure, the received data in 
the connectivity response messages is used to update the existing service level topology 
structure (add what is not already present). 

[00169] In block 2125, a link addition message is transmitted to nodes in the selected 
service level topology structiu'e. In certain embodiments, each link addition message 
includes a service level and a sent-to-set (all of the nodes in the service level topology 
apart from the source node). 

[00170] Figure 22 is a flow diagram illustrating the operations performed by an access 
node responsive to receiving a link addition message according to certain embodiments 
of the invention. 

[00171] As shown, in block 2210, connectivity request message(s) are transmitted to 
the qualifying adjacent node(s) and control passes to blocks 2215 and 2220. In certain 
embodiments, block 2210 is performed in a similar manner to block 1010. 

[00172] In block 2215, the service level topology structiu-e is updated responsive to 
connectivity response messages received. Block 2215 is performed in a similar fashion 
to block 1015 of Figure 10 with a variation. With regard to the variation on block 
1015, since certain data already exists in the service level topology structure, the 
received data in the connectivity response messages is used to update the existing 
service level topology structure (add what is not already present). 
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[00173] As shown in block 2220, nodes are selected from the service level topology 
structure that are not identified in the received link addition message and control passes 
to block 2225. hi certain embodiments of the invention, block 2220 is performed by: 1) 
identifying as "new set** all of the nodes in the service level topology structure that are 
not in the sent-to-set in the received link addition message (2205); and 2) forming an 
updated version of the sent-to-set that is the union of the new set and the sent-to set in 
the link addition message (2205). 

[00174] hi block 2225, a link addition message is transmitted to the selected nodes. 
As before, this link addition message will include the updated sent-to-set as opposed to 
the sent-to-set in the received link addition message (2005). 

Node Removal 

[00175] When a node is removed, the LSD is updated in the adjacent access node(s) 
(e.g., in certain embodiments of the invention, LMP recognizes the removal of the 
node). When a node is removed, the channels on its link(s) are no longer available all 
at once. While certain embodiments perform the link removal operations of Figures 19 
and 20 for each such link, other embodiment of the invention reduce the nimiber of 
messages generated by addressing the node as a whole. Li particular, figures 23 and 24 
are flow diagrams illustrating operations performed when a node is removed according 
to certain embodiments of the invention. The operations of Figure 23 are performed by 
the adjacent access node(s). As part of these operations, a node removal message is 
transmitted to certain other nodes. The operations of Figure 24 are performed by an 
access node responsive to such a node removal message. 

[00176] Figure 23 is a flow diagram illustrating the operations performed by the 
access node(s) adjacent a removed node according to certain embodiments of the 
invention. Block 2310 is used to indicate that the following blocks are performed for 
each service level. 

[00177] hi block 2315, the service level topology structure is updated and control 
passes to block 2320. hi certain embodiments of the invention, block 2315 is 
performed by removing from the service level topology structure the branch, if one 
exists, that has as the first hop the removed node. 
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[00178] As shown in block 2320, it is determined if the service level topology 
structure includes path(s) with the removed node. If not, control passes to block 2325 
where the flow diagram ends. If so, control passes to block 2330. In certain 
embodiments of the invention, block 2320 is performed by searching the service level 
topology structure for the presence of the removed node. 

[00179] As shown, in block 2330, connectivity request message(s) are transmitted on 
link(s) of these paths and control passes to blocks 2335 and 2340. In particular, the 
access node transmits a connectivity request message on each of its links that are part 
of these paths. 

[00180] In block 2335, a new service level topology structure is instantiated and 
updated responsive to connectivity response messages received. In certain 
embodiments, block 2325 is performed in a similar manner as blocks 1005 and 1015 
with a variation. In particular, the new service level topology structure preserves the 
channel states from the current service level topology structure (which is kept xmtil the 
new service level topology structure is completed). 

[00181] In block 2340, a node removal message is transmitted to nodes in the selected 
service level topology structure. In certain embodiments of the invention which 
instantiate a new service level topology stmcture as in block 2325, the service level 
topology stmcture used for block 2330 is the current service level topology structure. 
In certain embodiments, each link removal message includes a removed node ID, a 
service level, and a sent-to-set (all of the nodes in the service level topology apart from 
the removed node and the nodes adjacent the removed node). 

[00182] Figure 24 is a flow diagram illustrating the operations performed by an access 
node responsive to receiving a node removal message according to certain 
embodiments of the invention. 

[00183] In block 2410, it is determined if the service level topology structure includes 
path(s) with the removed node. If not, control passes to block 2415 where the flow 
diagram ends. If so, control passes to block 2420. In certain embodiments of the 
invention, block 2410 is performed by searching the service level topology structure for 
the presence of the removed node. 
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[00184] As shown, in block 2420, connectivity request message(s) are transmitted on 
link(s) of these paths and control passes to blocks 2425 and 2430. In particular, the 
access node transmits a connectivity request message on each of its links that are part 
of these paths. 

[00185] In block 2425, a new service level topology structure is instantiated and 
updated responsive to connectivity response messages received. In certain 
embodiments, block 2425 is performed in a similar manner as blocks 1005 and 1015 
with a variation. In particular, the new service level topology structure preserves the 
channel states from the current service level topology structure (which is kept until the 
new service level topology structure is completed). 

[00186] As shown in block 2430, nodes are selected from the service level topology 
structure that are not identified in the received node removal message and control 
passes to block 2435. In certain embodiments of the invention, block 2430 is 
performed by: 1) identifying as "new set" all of the nodes in the current service level 
topology structure that are not in the sent-to-set in the received node removal message 
(2405); and 2) forming an updated version of the sent-to-set that is the union of the new 
set and the sent-to set in the node removal message (2405). 

[00187] In block 2435, a node removal message is transmitted to the selected nodes. 
As before, this node removal message will include the updated sent-to-set as opposed to 
the sent-to-set in the received node removal message (2005). 

[00188] While in certain embodiments of the invention, nodes and their paths are 
deleted immediately and added back in (see the node addition section) if they are 
reestablished, altemative embodiments provide other mechanisms (e.g., in certain 
embodiments of the invention the paths are marked broken are maintained indefinitely, 
in other embodiments of the invention the paths are marked broken and deleted after a 
period of time if the node is not reestablished, etc.). 

Node Addition 

[00189] When a node is added, the added node performs the flows in figures 9 and 10. 
In addition, the LSD is updated in the adjacent access node(s) (e.g., in certain 
embodiments of the invention, LMP recognizes the removal of the node). Additionally, 
for each of the adjacent nodes, there has effectively been one or more links added to the 
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new node. As such, each of the adjacent node(s) performs the flow of figure 21, with 
the exception that block 2125 is replaced with a different operation. In particular, 
instead of block 2125, a node addition message is transmitted to nodes in the selected 
service level topology structure. In certain embodiments, each node addition message 
includes an added node ID, a service level and a sent-to-set. The message is sent to, 
and the sent-to-set includes, any nodes in the service level topology apart from the 
source node. 

[00190] Figure 25 is a flow diagram illustrating the operations performed by an access 
node responsive to receiving a node addition message according to certain 
embodiments of the invention. 

[00191 ] As shown, in block 25 1 0, connectivity request message(s) are transmitted to 
the qualifying adjacent node(s) and control passes to blocks 2515 and 2520. In certain 
embodiments, block 2510 is performed in a similar manner to block 1010. 

[00192] In block 251 5, a new service level topology structure is instantiated and 
updated responsive to connectivity response messages received. In certain 
embodiments, block 2515 is performed in a similar manner as blocks 1005 and 1015 
with a variation. In particular, the new service level topology structure preserves the 
channel states from the current service level topology structure (which is kept until the 
new service level topology structure is completed). 

[00193] As shown in block 2520, nodes are selected from the service level topology 
structure that are not identified in the received node addition message and control 
passes to block 2525. In certain embodiments of the invention, block 2520 is 
performed by: 1) identifying as "new set" all of the nodes in the current service level 
topology structure that are not in the sent-to-set in the received node addition message 
(2505); and 2) forming an updated version of the sent-to-set that is the union of the new 
set and the sent-to set in the node addition message (2505). 

[00194] In block 2525, a node addition message is transmitted to the selected nodes. 
As before, this node addition message will include the updated sent-to-set as opposed to 
the sent-to-set in the received node addition message (2505). 

Service Level Parameter Changes 
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[00195] In certain embodiments of the invention, the service provider may update the 
service level parameters and push a fresh copy on each node. If and when a new QoS 
criteria is added, certain embodiments of the invention perform the following: 

1. The contents of the service level parameters database is copied and kept in the 

memory. 

2. The service level parameters database is populated with new data. 

3. Blocks 915 and 920 are performed to create new service level topology 

structures, keeping the existing service level topology structure for each service 
level. 

4. The new service level topology structures are used for new connections. 

5. The previous service levels are mapped to the current service levels by 

comparing the parameters. 

6. The connection status from the old service level topologies are mapped to the 

new service level topology structures to relevant service levels. 

7. The old service level topologies are deleted. 

[00196] Similarly, if an when an existing service level parameter(s) is changed, certain 
embodiments of the invention perform the following: 

1. The contents of the particular level in service level parameters database is copied 

and kept in the memory. 

2. The service level parameters database is populated with new data. 

3. New service level topology structures are built for the updated levels keeping the 

old service level topology structures. 

4. The new service level topology structures are used for new connections. 

5. The previous service levels are mapped to the current service levels by 

comparing the parameters. 

6. The connection status from the old service level topologies are mapped to the 

new service level topology structures to relevant service levels. 

7. The old service level topologies are deleted. 
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[00197] Of course, alternative embodiments may handle such changes in other ways. 



Exemplary Load Balancing 
[00198] Where there are multiple shortest paths available, the issue of load balancing 
comes into play. For instance, certain embodiments of the invention implement load 
balancing to allow the service provider some options. Specifically, when a demand is 
received, there can either be: 1) a set of multiple shortest paths; or 2) a single shortest 
path. Where there is a set of multiple shortest paths, wavelengths are selected fi'om 
each member of the set in round robin fashion. However, when there is a single 
shortest path, either one of two schemes is used. In the first scheme, a threshold is 
specified (e.g., specified by the service provider) for any link in the network. If the 
nimiber of channels for a particular service level crosses the threshold on that link, then 
that link becomes unavailable for any fixture demand. This allows the service provider 
to tailor the traffic flow on the network. In the second scheme, a distribution ratio 
system is used. Specifically, the ratio is the number of new paths "allocated to non- 
shortest path" to "the shortest path." 

Exemplarv Contention Resolution 
[00199] Since requests for paths by different access nodes may overlap, there is a need 
for contention resolution. Certain embodiments of the invention resolve contention 
issues by giving priority to the source with the higher IP number. However, this brings 
in a special case where a source node may be receiving demand request at a higher 
fi-equency than the other source node. The other source node, thus, potentially may 
starve. 

[00200] Other embodiments of the invention use one of the following contention 
resolution schemes to overcome this deficiency. 

1. One such scheme is to pre-allocate a lightpath for the next demand in advance. 

This result in each access node preallocating lightpaths to each accessible node 
at each service level. As such, this scheme can put a relatively high amount of 
strain on network resources. 

2. Another such scheme is referred to herein as highest service level preallocation. 

Instead of preallocating lightpaths to each accessible node for each service 
level, this is done only for the highest service level. In the case of an 
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unfavorable settlement of contention during demand allocation, the demand is 
allocated on the preallocated lightpath at the highest service level. As such, this 
scheme puts a relatively lower amount of strain on network resources, but can 
cause the highest service level lightpaths to get used up the fastest. 

3. Yet another such scheme is referred to herein as default service level 

preallocation. In particular, for each source to destination pair, an indication of 
the default service level is maintained (e.g., the most common service level for 
historically received demands). Instead of preallocating lightpaths to each 
accessible node for each service level or preallocating lightpaths to each 
accessible node at the highest service level, preallocation is done only for the 
default service level for each source to destination pair. In the case of an 
unfavorable settlement of contention during demand allocation, the demand is 
allocated on the preallocated lightpath at the default service level. As such, this 
scheme puts a relatively lower amount of strain on network resources than 
scheme 1 and attempts to avoid using up the highest service level the fastest by 
predicting the most common service level. 

Aggregating 

[00201] While embodiments have been described in which separate messages are 
transmitted, alternative embodiments aggregate different ones of such messages. For 
instance, certain embodiments aggregate messages for different service level topologies 
during startup. 

Altemative Embodiments 

[00202] While various embodiments of the invention has been described, altemative 
embodiments of the invention can operate differently. For instance, while the flow 
diagrams in the figures show a particular order of operations performed by certain 
embodiments of the invention, it should be understood that such order is exemplary 
(e.g., altemative embodiments may perform the operations in a different order, combine 
certain operations, overlap certain operations, etc.) In addition, while certain 
embodiments have been described that operate to reduce the number of 
communications between nodes by transmitting messages to only selected nodes (e.g., 
blocks 1250, 1320, 1430/1435, 1525, 1630/1635, 1725, and 1830/1835), altemative 
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embodiments may be implemented to transmit such messages to more, less, or different 
nodes using different schemes (e.g., certain alternative embodiments broadcast each 
such message to every node). As another example, while certain embodiments of the 
invention have been described with respect to distributed search techniques for 
building/maintaining network topology databases and with respect to a source based 
scheme, alternative embodiments could be implemented different ways or combinations 
of ways (e.g., centralized network topology database building/maintaining, centralized 
provisioning, hybrids, etc.). 

[00203] While the invention has been described in terms of several embodiments, 
those skilled in the art will recognize that the invention is not limited to the 
embodiments described, can be practiced with modification and alteration within the 
spirit and scope of the appended claims. The description is thus to be regarded as 
illustrative instead of limiting. 
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